1 link tagged with all of: llama.cpp + twil 8b + granite 4.2
Click any tag below to further narrow down your results
Links
This is the Hugging Face model card for TwIL-8B, an 8.8B-parameter model fine-tuned from IBM's Granite 4.2 for math, code and instruction following. The card covers how to run it through Transformers, llama.cpp, vLLM, Ollama and several local apps, plus benchmark results against similar-sized open models.
- Scores 98.2 on MATH-500 and 81.6 on LiveCodeBench (verbose variant), the top results in its comparison group, with a Q4_K_M quantized GGUF about 5 GB so it runs on modest hardware.
- Trails on knowledge-heavy benchmarks: GPQA Diamond is 11.5 points behind Qwen3.5-9B, and the model is not a general knowledge model.
- Uses about 38% fewer output tokens per AIME 2026 problem than Qwen3.5-9B, though it is still far more verbose than frontier models.